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CLAIM 

1. A remote image display method, characterized by the steps of: 
image sensing a panoramic object by a remote image sensing device; 

5 sending a video signal of a part of said image-sensed panoramic object 

via an image capturing device to image display means at a place different 
from said remote image sensing device; 

playing back and displaying said received video signal by said image 
display means as an image of a part of said panoramic object; 
10 image sensing its surroundings by a camera -equipped portable 

terminal at a position where the display on said image display means can be 
seen, and sending the surrounding video signal to said image capturing 
device; 

obtaining variation information about the surrounding image from said 
15 camera-equipped portable terminal by said image capturing device based on a 
previous received surrounding video signal and the current received 
surrounding video signal; 

obtaining from said remote image sensing device a video signal of a 
part of said panoramic object changed corresponding to a change of said 
20 surrounding image based on said variation information; and 

sending said obtained image signal to said image display means. 

2. An image capturing device comprising: 

surrounding image receiving means for receiving a surrounding video 
signal from a camera-equipped portable terminal; 
25 variation detecting means for detecting, from said received 

surrounding video signal, information about a variation of the image of the 
current surrounding video signal (hereinafter referred to as the current image) 
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from the image of a previous surrounding video signal (hereinafter referred to 
as the previous image) received by said surrounding image receiving means; 

capturing signal generating means for generating a capturing signal 
from said variation information which is used to obtain the video signal of a 
5 part of a panoramic object; 

signal sending means for said capturing signal to a remote image 
sensing device that performs image sensing of a panoramic object and outputs 
a video signal; and 

image relay means for receiving said video signal from said remote 
10 image sensing device and for sending the received video signal to image 

display means at the same position as said camera-equipped portable terminal. 

3. The device of claim 2, wherein: 

said variation detecting means is a means for detecting, as said 
variation information, direction information corresponding to the direction of 

15 movement of said current image with respect to said previous image or/and 
zoom information corresponding to a change in the size of the part of said 
current image corresponding to a part of said previous image; and 

said capturing signal generating means is a means for generating, as 
said capturing signal, an extracting reference pixel position signal obtained by 

20 correcting a previous extracting reference pixel position signal according to 
said direction information or/and an image zoom in/out signal corresponding 
to said zoom information. 

4. The device of claim 2, which further comprises: 

camera direction storage means in which there is stored identification 
25 information of each of plural camera devices provided in said remote image 
sensing device and angularly spaced apart in their shooting direction; and 
wherein: 
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said variation detecting means is a means for detecting, as said 
variation information, direction information corresponding to the direction of 
movement of said current image with respect to said previous image; and 

said capturing signal generating means is a means which determines 
5 the shooting direction by referring to said camera direction storage means 
based on a previously generated transmitting camera identification 
information signal and said direction information, for generating, as said 
capturing signal, a transmitting camera identification information signal of the 
camera identification information corresponding to said determined shooting 
10 direction. 

5. The device of claim 2, wherein: 

said variation detecting means is a means for detecting, as said 
variation information, direction information corresponding to the direction of 
movement of said current image with respect to said previous image or/and 
15 zoom information corresponding to a change in the size of said current image 
with respect to said previous image; and 

said capturing signal generating means is a means for generating, as 
said capturing signal, a shooting direction change signal corresponding to said 
direction information or/and zoom change signal corresponding to said zoom 
20 information. 

6. The device of claim 2, wherein: 

said surrounding image receiving means is a means for receiving the 
surrounding video signal from each of a plurality of camera-equipped portable 
terminals; and 

25 said variation detecting means is a means provided with a previous 

frame memory for storing a surrounding video signal used for detecting the 
previous variation information for each camera-equipped portable terminal 
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having transmitted its received surrounding video signal, for detecting 
variation information corresponding to said camera-equipped portable 
terminal having transmitted the received surrounding video signal, based on 
the received surrounding video signal and the surrounding video signal stored 
5 in said previous frame memory corresponding to said camera-equipped 
portable terminal having transmitted the surrounding video signal; 

said capturing signal generating means is a means provided with a 
previous signal memory for storing a previously generated capturing signal 
for each camera-equipped portable terminal having transmitted its received 

10 surrounding video signal, for generating a capturing signal corresponding to 
said detected camera-equipped portable terminal from the variation 
information corresponding to said detected camera-equipped portable 
terminal and said previously generated capturing signal stored in said 
previous signal memory corresponding to said detected camera-equipped 

15 portable terminal, and for updating the corresponding to signal in said 
previous signal memory with said generated capturing signal; 

said signal sending means is a means for sending said generated 
capturing signal and information for identifying the camera-equipped portable 
terminal corresponding thereto; and 

20 said image relay means is a means for sending its received video 

signal to said image display means of the camera-equipped portable terminal 
indicated by camera-equipped portable terminal identification information 
received together with said video signal. 

7. An image capturing device comprising: 

25 surrounding image receiving means for receiving a surrounding vide 

signal from a camera-equipped portable terminal; 

variation detecting means for detecting, from said received 
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surrounding video signal, information about a variation of the image of the 
current surrounding video signal (hereinafter referred to as the current image) 
from the image of a previous surrounding video signal (hereinafter referred to 
as the previous image) received by said surrounding image receiving means; 
5 capturing signal generating means for generating, from said variation 

information and a previously generated capturing signal, a capturing signal 
that is used to obtain a video signal of a part of a panoramic object; 

remote image receiving means for receiving a video signal sent from a 
remote image sensing device having performed image sensing of a panoramic 
10 object; 

image capturing means for capturing the video signal of a part of the 
panoramic object from said received video signal based on said capturing 
signal; and 

image sending means for sending said captured video signal to image 
15 display means at the same position as that of said camera-equipped portable 
terminal. 

8. The device of claim 7, wherein: 

the video signal received by said remote image receiving means is a 
panorama video signal; 

20 said variation detecting means is a means for detecting, as said 

variation information, direction information corresponding to the direction of 
movement of said current image with respect to said previous image or/and 
zoom information corresponding to a change in the size of the part of said 
current image corresponding to a part of said previous image; 

25 said capturing signal generating means is a means for generating, as 

said capturing signal, an extracting reference pixel position signal obtained by 
correcting a previous extracting reference pixel position signal according to 
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said direction information or/and an image zoom in/out signal corresponding 
to said zoom information; and 

said image capturing means is a means for capturing, from said 
panorama video signal, one frame of video signal produced by zooming in/out, 
5 by said image zoom in/out signal relative to the image of the previously sent 
captured video signal, a partial image of the panorama image of said 
panorama video signal that is defined by one frame of video signal or/and the 
previously generated extracting reference pixel position signal, or said 
corrected extracting reference pixel position signal with reference to the 
10 position on the panorama image that is determined by said corrected 
extracting reference pixel position signal. 

9. The device of claim 7, wherein: 

the video signal received by said remote image receiving means is 
video signals from a plurality of camera devices of said remote image sensing 
15 device with their shooting directions angularly spaced apart; and 
which further comprises: 

camera direction storage means having stored herein identification 
information about said plurality of camera devices and information 
corresponding to their shooting directions; and 
20 wherein: 

said variation detecting means is a means for detecting, as said 
variation information, direction information corresponding to the direction of 
movement of said current image with respect to said previous image; 

said capturing signal generating means is a means which determines 
25 the shooting direction by referring to said camera direction storage means 
based on a previously generated transmitting camera identification 
information signal and said direction information, for generating, as said 
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capturing signal, a transmitting camera identification information signal of the 
camera identification information corresponding to said determined shooting 
direction; and 

said image capturing means is a means for capturing that one of a 
5 plurality of video signals which corresponding to said generated camera 
identification signal. 

10. The device of claim 9, wherein: 

said variation detecting means includes a means for detecting, as said 
variation information, second direction information corresponding to the 

10 direction of movement of said current image with respect to said previous 
image in a direction perpendicular to the direction of movement of said 
detected direction information or/and zoom information corresponding to a 
change in the size of that part of said current image corresponding to a part of 
said previous image; 

15 said capturing signal generating means is a means for generating, as 

said capturing signal, an extracting reference pixel position signal obtained by 
correcting a previous extracting reference pixel position signal according to 
said second direction information or/and an image zoom in/out signal 
corresponding to said zoom information; and 

20 said image capturing means is a means for capturing, from said 

captured video signal, one frame of video signal produced by zooming in/out, 
by said image zoom in/out signal relative to the image of the previously sent 
captured video signal, a partial image of the image of said captured video 
signal that is defined by one frame of video signal or/and the previously 

25 generated extracting reference pixel position signal, or said corrected 

extracting reference pixel position signal with reference to the position on the 
panorama image that is determined by said corrected extracting reference 
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pixel position signal. 

11. The device of claim 7, wherein: 

said surrounding image receiving means is a means for receiving a 
surrounding video signal from each of a plurality of camera-equipped portable 
5 terminals; 

said variation detecting means is a means provided with a previous 
frame memory for storing a surrounding video signal used for detecting the 
previous variation information for said each camera-equipped portable 
terminal having transmitted its received surrounding video signal, for 

10 detecting variation information corresponding to said each camera-equipped 
portable terminal, based on the received surrounding video signal and the 
surrounding video signal stored in said previous frame memory corresponding 
to said camera-equipped portable terminal; 

said capturing signal generating means is a means provided with a 

15 previous signal memory for storing a previously generated capturing signal 
for each camera-equipped portable terminal having transmitted its received 
surrounding video signal, for generating a capturing signal corresponding to 
said detected camera-equipped portable terminal from the variation 
information corresponding to said detected camera-equipped portable 

20 terminal and said previously generated capturing signal stored in said 

previous signal memory corresponding to said detected camera-equipped 
portable terminal, and for updating the corresponding to signal in said 
previous signal memory with said generated capturing signal; 

said image capturing mean is a means for capturing a video signal for 

25 each capturing signal corresponding to each camera-equipped portable 
terminal stored in said previous signal memory; and 

said image sending means is a means for sending said captured video 
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signal for said each camera-equipped portable terminal to image display 
means at the same position as that of said each camera-equipped portable 
terminal. 

12. The device of claim 2 or 7, characterized by the provision of: 

5 variation hysteresis storage means for storing the hysteresis of said 

variation information; 

decision means for deciding whether the variation information 
detected by said variation detecting means is abnormal or not by referring to 
hysteresis information stored in said variation hysteresis storage means; and 
10 means which, when said decision means decides that said variation 

information is abnormal, inhibits the supply of said detected variation 
information to said capturing signal generating means. 

13. A processing method of an image capturing device, characterized 

by: 

15 a first step of deciding whether an operation (hereinafter referred to as 

camera operation) command for changing the shooting direction of a camera 
or/and the lens field angle (zoom amount) is received or not; 

a second step of receiving a surrounding video signal of a surrounding 
object from a camera-equipped portable terminal when it is decided in said 
20 first step that said command is received; 

a third step of detecting, from the received surrounding video signal, 
variation information indicating a variation of the image of the surrounding 
video signal from the image of the previous surrounding video signal; 

a fourth step of generating a capturing signal for capturing a video 
25 signal of a part of a panoramic object based on the previous capturing signal 
and said variation information (which part will hereinafter be referred to as a 
partial object); 
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a fifth step of sending said generated capturing signal to a remote 
image sensing device which performs image sensing of said panoramic 
object; 

a sixth step of receiving a video signal from the remote image sensing 

5 device; 

a seventh step of sending said received video signal to image display 
means at the same position as that of said camera-equipped portable terminal; 
and 

an eighth step of deciding whether a camera operation stop command 
10 is received; 

wherein if the operation command is not received in said first step, 
processing proceeds to said sixth step, and if the stop command is not 
received in said eighth step, processing returns to said first step. 

14. A processing method of an image capturing device, characterized 

15 by: 

a first step of deciding whether an operation (hereinafter referred to as 
camera operation) command for changing the shooting direction of a camera 
or/and the lens field angle (zoom amount) is received or not; 

a second step of receiving a surrounding video signal of a surrounding 
20 object from a camera-equipped portable terminal when it is decided in said 
first step that said command is received; 

a third step of detecting, from the received surrounding video signal, 
variation information indicating a variation of the image of the surrounding 
video signal from the image of the previous surrounding video signal; 
25 a fourth step of generating a capturing signal for capturing a video 

signal of a part of a panoramic object based on the previous capturing signal 
and said variation information (which part will hereinafter be referred to as a 
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partial object); 

a fifth step of receiving a video signal from a remote image sensing 

device; 

a sixth step of capturing a video signal of a part of a panoramic object 
from said received video signal based on said generate capturing signal; 

a seventh step of sending said captured video signal to image display 
means at the same position as that of said camera-equipped portable terminal; 
and 

an eighth step of deciding whether a camera operation stop command 
is received; 

wherein if the operation command is not received in said first step, 
processing proceeds to said fifth step, and if the stop command is not received 
in said eighth step, processing returns to said first step. 

15. (cancel) 



16. An image capturing device comprising: 

signal receiving means for receiving variation information signals 
from a plurality of user terminals; p. 
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capturing signal generating means provided with a previous signal 
memory for storing previously generated capturing signals for each piece of 
information (hereinafter referred to as user terminal identification 
information) identifying the user terminal having sent the said variation 
5 information signal, for generating, from the received variation information 
signal and the previously generate capturing signal of the user terminal 
identification information stored in the previously memory, a capturing signal 
to be used for capturing a video signal of a part of a panoramic object (which 
part will hereinafter be referred to as a partial object); 
10 signal sending means for sending said generated capturing signal and 

the corresponding user terminal identification information to a remote image 
sensing device which performs image sensing of the panoramic object and 
outputs its video signal; and 

image relay means for receiving the video signal and the 
15 corresponding user terminal identification information from said remote 

image sensing device and sending the video signal to image display means of 
the user terminal corresponding to the user terminal identification 
information. 

17. The device of claim 16, wherein: 
20 said variation information signal is a direction information signal 

or/and a zoom signal of the partial object desired to switch from the previous 
partial object; and 

said capturing signal generating means is a means for generating, as 
said capturing signal, an extracting reference pixel position signal obtained by 
25 correcting a previous extracting reference pixel position signal according to 
said direction information or/and an image zoom in/out signal corresponding 
to said zoom information. 
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18. The device of claim 16, which further comprises: 
camera direction storage means in which there is stored identification 
information of each of plural camera devices provided in said remote image 
sensing device and angularly spaced apart in their shooting direction; and 
5 wherein: 

said variation information signal is a first direction information signal 
of the partial object desired to change from the previous partial object and/or 
a second direction information signal of the first direction information signal 
or/and a zoom signal of the desired partial object; and 

10 said capturing signal generating means is a means which determines 

the shooting direction by referring to said camera direction storage means 
based on a previously generated transmitting camera identification 
information signal and said direction information, for generating, as said 
capturing signal, a transmitting camera identification information signal of the 

15 camera identification information corresponding to said determined shooting 
direction, and/or a reference pixel position signal obtained by correcting said 
generated reference pixel position corresponding to said second direction 
information signal or/and an image zoom in/out signal corresponding to said 
zoom information signal. 

20 19. An image capturing device comprising: 

signal receiving means for receiving variation information signals 
from a plurality of user terminals; 

capturing signal generating means provided with a previous signal 
memory for storing previously generated capturing signals for each piece of 

25 information (hereinafter referred to as user terminal identification 

information) identifying the user terminal having sent the said variation 
information signal, for generating, from the received variation information 
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signal and the previously generate capturing signal of the user terminal 
identification information stored in the previously memory, a capturing signal 
to be used for capturing a video signal of a part of a panoramic object (which 
part will hereinafter be referred to as a partial object); 
5 signal sending means for sending said generated capturing signal and 

the corresponding user terminal identification information to a remote image 
sensing device which performs image sensing of the panoramic object and 
outputs its video signal; 

remote image means for receiving the video signal sent from the 
10 remote image sensing device having performed image sensing of a panoramic 
object; 

image capturing means for capturing the video signal of a part of the 
panoramic object from said received video signal based on the capturing 
signal for each user terminal identification information stored in said previous 
15 signal memory; and 

image sending means for sending said captured video signal to the 
user terminal of th user terminal identification information. 

20. The device of claim 19, wherein: 

the video signal received by said remote image receiving means is a 
20 panorama video signal; 

said variation information signal is a direction signal or/and a zoom 
information signal for the partial object desired to switch from the previous 
partial object; 

said capturing signal generating means is a means for generating, as 
25 said capturing signal, an extracting reference pixel position signal obtained by 
correcting a previous extracting reference pixel position signal according to 
said direction information or/and an image zoom in/out signal corresponding 
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to said zoom information; and 

said image capturing means is a means for capturing, from said 
panorama video signal, one frame of video signal produced by zooming in/out, 
by said image zoom in/out signal relative to the image of the previously sent 
5 captured video signal, a partial image of the panorama image of said 

panorama video signal that is defined by one frame of video signal or/and the 
previously generated extracting reference pixel position signal, or said 
corrected extracting reference pixel position signal with reference to the 
position on the panorama image that is determined by said corrected 
10 extracting reference pixel position signal. 

21. The device of clam in 19, wherein: 

the video signal received by said remote image receiving means is 
video signals from a plurality of camera devices of said remote image sensing 
device with their shooting directions angularly spaced apart; and 
15 which further comprises: 

camera direction storage means having stored herein identification 
information about said plurality of camera devices and information 
corresponding to their shooting directions; 

wherein: 

20 said variation information signal is a first direction information signal 

of the partial object desired to change from the previous partial object or/and 
a second direction information signal of the desired partial object in a 
direction perpendicular to that of the first direction information signal or/and 
a zoom signal of the desired partial object; 

25 said capturing signal generating means is a means which determines 

the shooting direction by referring to said camera direction storage means 
- based on a previously generated transmitting camera identification 



65 

information signal and said direction information, for generating, as said 
capturing signal, a transmitting camera identification information signal of the 
camera identification information corresponding to said determined shooting 
direction, and/or a reference pixel position signal obtained by correcting said 
5 generated reference pixel position corresponding to said second direction 
information signal or/and an image zoom in/out signal corresponding to said 
zoom information signal; and 

said image capturing means is a means for capturing that one of a 
plurality of video signals which corresponds to said generated camera 

10 identification signal, and for capturing, from said captured video signal, one 
frame of video signal produced by zooming in/out, by said image zoom in/out 
signal relative to the image of the previously sent captured video signal, a 
partial image of the image of said captured video signal that is defined by one 
frame of video signal or/and the previously generated extracting reference 

15 pixel position signal, or said corrected extracting reference pixel position 

signal with reference to the position on the panorama image that is determined 
by said corrected extracting reference pixel position signal. 

22. A program for functioning a computer as said image capturing 
device described in any one of claims 2 to 12 and 16 to 21. 



